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This article is an extension of a recent paper by McEliece and Swanson dealing with 
the decoder error probability for Reed-Solomon codes (more generally , linear MDS 
codes). McEliece and Swanson offered an upper bound on P E (u), the decoder error prob- 
ability given that u symbol errors occur. This upper bound is slightly greater than Q, the 
probability that a completely random error pattern will cause decoder error. In this 
article , by using a combinatoric technique- the principle of inclusion and exclusion- 
an exact formula for P E (u) is derived. 

The ? E (u )’sfor the (255, 223) Reed-Solomon Code used by NASA, and for the (31,15) 
Reed-Solomon code (JTIDS code), are calculated using the exact formula, and the 
P E (u)’s are observed to approach the Q’s of the codes rapidly as u gets large. An upper 
bound for the expression |/P E (u)/Q/ - 1\ is derived, and is shown to decrease nearly 
exponentially as u increases. This proves analytically that P E fu) indeed approaches Q as u 
becomes large, and some laws of large numbers come into play. 


I. Weight Distribution Formula for 
Decodable Words in a Linear 
MDS Code 

A. Introduction 

We begin with the following definitions. Let C be a linear 
code of length n, dimension k , and minimum distance d. Let 
q be a positive power of a prime. An (n,k,d) linear code C over 
GF(q) is maximum distance separable (MDS) if the Singleton 
bound is achieved; that is, d = n - k + 1 . A code is f -error cor- 
recting if for some integer f, 2t < d - 1 . 

The class of Reed-Solomon (RS) codes is a subclass of MDS 
codes. Reed-Solomon codes are used in many sectors of to- 


day’s industry. Some examples are the (255, 223) 16-error 
correcting RS code (the NASA code) in deep space communi- 
cations, the (31,15) 8-error correcting RS code (the JTIDS 
code) in military communications, and the Cyclic Interleaving 
RS Code (CIRC) in the compact disc industry. A detailed 
treatment of MDS codes, their properties and open questions 
about them is given in [1] . The weight distribution of a linear 
MDS code with the parameters n, k,d, t , and q was indepen- 
dently found by three grotips of researchers: Assmus, Mattson 
and Turyn [2] , Forney [3] , and Kasami, Lin and Peterson 

[4] • 

In Section I, we rederive the weight distribution formula 
for a linear MDS code by using the principle of inclusion and 
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exclusion, and then extend this method to obtain the exact 
weight distribution formula for “decodable words” in any 
linear MDS code. By decodable words, we mean all the words 
that lie within distance t from a codeword. If we assume the 
decoder to be a bounded distance decoder, then the weight 
distribution formula for the decodable words can be used to 
find the undetected error probability for linear MDS codes. 
This will be discussed in detail in Section II. 
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Section I is divided into 5 parts. Part I.A is a brief intro- 
duction. In I.B, we review some basic mathematical tools that 
are needed to derive the formulae. In I.C, we first derive the 
weight distribution formula for the number of codewords in 
a linear MDS code, and then we derive the weight distribution 
formula for the number of decodable words in a linear MDS 
code. In I.D, we give some numerical examples, and finally, 
in I.E, we end Section I of this article with some concluding 
remarks. 

B. Some Basic Tools 

In this part, we review the basic tools that are required to 
derive the weight distribution formulae for the number of 
codewords in a linear MDS code and for the number of decod- 
able words in a linear MDS code. 

Let C be an ( n , k) code over GF(q ), not necessarily linear. 
If we examine any set of k - 1 components of the codewords, 
we find that there are only q k ~ l possibilities for the q k code- 
words. Thus, there must be a pair of codewords that agree on 
these k - 1 components, and so the minimum distance d of 
the code must satisfy d < n - k + 1. This upper bound on d 
is known as the Singleton bound, and a code for which d = 
n - k + 1 is called an MDS code. RS codes and cosets of RS 
codes are examples of MDS codes. 

One important tool that we need is the basic combinatoric 
property of the MDS code. Let K be a subset offc coordinate 
positions of an MDS code. If two codewords were equal on K , 
the distance between them would be at most n - k. This 
contradicts the fact that d = n - k + 1 . Thus, all q k codewords 
are different in K. Let a = , a 2 , • • • , a k ) be a fc-tuple of 

elements from GF(q). From the above argument, there exists 
a unique codeword whose k coordinates in K equal the k com- 
ponents of a. We call this important fact the basic combina- 
torial property of MDS codes. 

Another important tool that we need is the principle of 
inclusion and exclusion [5] . Suppose we have N objects and a 
number of properties P(l), ■ * * , P(n). Let N t be the number 
of objects with property P(i), and ^ ^ be the number 

of objects with properties P^), P(z 2 ), • * • ,P(/ r ). The number 
of objects ^(0) with none of the properties is given by the 
following formula: 


The proof can be found in [5] . 

The basic combinatorial property of MDS codes and the 
principle of inclusion and exclusion will be referred to in the 
proofs in later sections. 

C. Derivation of Formulae 

This part is divided into three subparts. In the first, we 
derive the formula for the number of codewords of weight u 
in a linear MDS code, using the principle of inclusion and 
exclusion. In the second, we extend this idea by deriving a 
general formula for the number of decodable words of weight 
u. Last of all, in the third, we simplify the key formula by 
using some combinatoric identities. 

1 . Formula for the number of codewords of weight u. Let 

c be some codeword of C. Let c have a Hamming weight u, 
u > d. Let the coordinates of codeword c be indexed by 
{0, 1, 2, • • • , n - 1 }. Define v = n - u. Then c has v zeros. We 
now want to find the number of codewords of weight u in C 
having exactly v zeros at some particular v coordinates where 
v - n(u = 0) or v < n - d = k - 1 (u > d). Since the code is 
linear, the number of codewords of weight zero ( u = 0) is 
one— the all zero codeword. The following discussion applies 
only to codewords with weight u > d. 

Let V be a set of v coordinates, \ V\-v. Let {i l , i 2 , • • • , 
ij} C {1, 2, • • • , n} - V be a set of / coordinates. Define 
5(«j, / 2 , * * * , i ; ) = {c : c E C and c has zeros in V and 
{/j , / 2 , • * • , ij} }. For / < k - v, the number of zeros in a 
codeword in S(i x , i 2 , • ■ ■ , ij) is at least / + v < k(f + v < k). 
By using the basic combinatorial property of MDS code, for 
each particular choice of {ij, i* 2 , , ij} we can specify 

qk-v-j codewords having zeros at V and {i x , i 2 , • • • , ij }. So 

I s (/, , i 2 , ■ • • , ij) | = q k ' v ~’ 0 <j <k-v (2) 

For / > k - v + 1, the number of zeros in a codeword is / + v 
> k + 1. This implies that the weight of the codeword is less 
than d, so SQ X , i 2 , • • • , = {0 }. That is, 

| S Oj , i 2 , • • • , | = 1 k-v + l<j <u (3) 
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Note that we choose i x , i 2 , • • • , ij from a set of u = n - v coor- 
dinates so that for every choice of /, we have , i 2 > * * * , 

'A 

By the principle of inclusion and exclusion, the number of 
codewords with exactly v zeros at V equals 


| 5(0) I - 2 I 50,) I + • • +(-!)“ ISO, ,i v ' • • ,i u ) I 
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Theorem 1 : 
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Proof: The argument here is similar to the derivation given 
in I.C.l, above. We note that each coset of a linear MDS code 
is also an MDS code. Also, since all words lying within the 
Hamming spheres (with volume that surround code- 

words are decodable words, we have V n (t) disjoint cosets that 
contain decodable words. From the basic combinatorial prop- 
erty of the MDS code we can, for each particular choice of 
0 * 1 , j 2 ,* * • , ij}, specify q k ~ v -f = qu-d+i~j decodable words to 
each of these cosets. Thus, we have altogether V n (t) 

decodable words having zeros at V and (ij, z 2 , • • • , i-}. This 
completes the proof. ■ 

Theorem 2: 


We have (") = (”) ways to choose v zeros from {0, 1, 2, • • * , 
n - 1 }. Thus, the number of codewords of weight w, which is 
denoted by A u , is given by the following expression: 


~ /n-u + A 

iso,, *2’ ’ ! /)i £ ( w ) 

w=d-u+j v ' 



After deriving this relatively simple formula for the number 
of codewords of weight u in a linear MDS code, we proceed to 
derive the more complicated formula for the number of de- 
codable words of weight u in a linear MDS code. 


X 


w-d+u-j 

L (- 1 ) 


i=0 
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2. General formula for the number of decodable words of 
weight u. Let D be the set of decodable words in an MDS 
code. Let Fbe a set of v coordinates, | V\ = v. Let {i x , i 2 , • * • , 
ij} be a set of / coordinates, where {i t , i 2 , • * * , }_C (0, 1, 
2, • • • , n - 1 } - V. Define S(i x , i 2 , * * * , ij) = {d : d GZ) and 
d has zeros in V and {i x , i 2 ,***,*)} } • We proceed to derive 
the weight distribution formula for the number of decodable 
words of weight w in a linear MDS code by using the principle 
of inclusion and exclusion. Our problem is now reduced to 
finding the cardinality of S(i t , z 2 , • * * , for all / subjected to 
a given V. This problem is solved with the help of the follow- 
ing theorems. 


for u - d + 1 < / < u — d + t. 

Proof: For u - d + 1 = k - v < /, the number of zeros in a 
decodable word is equal to v + / > k. Since d is a decodable 
word, d can be uniquely decomposed into a codeword c and 
an error pattern e with weight that is less than or equal to t. 
If we “project” c onto V U , i , * * • , i.} 9 then the result 
will be a certain (v + /, k) code. Since the parent code has a 
minimum distance d = n - k + 1 , the new code must have a 
minimum distance d' > d ~ (n - v - j) = (v + /)>-/:+ 1. Since 
it is impossible for d’ of the (v + /, k) code to be greater than 
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(v + /) - k + 1 (because of the Singleton bound), d ' must be 
equal to d - (n - v - /) = (v + /) - k + 1 . 


If c + e" vanishes on 7 U {/j , z 2 , * * * , ij }, then c must have 
weight that is less than or equal to / on F U {i l , z‘ 2 , ■ * * , /)}. 
Let w be the weight of c on FU {i t , z 2 , • * • , z)}. From the 
above argument we also know that C, when restricted to FU 
{/j , i 2 , * • • , z)}, is a linear (v + /, fc) MDS code with a mini- 
mum distance d - (n - v - j) - (v + /) - k + 1. Thus, w is 
either 0 (in the case of the all-zero codeword) or between 
d - u + j and t. So the number of codewords of weight w in 
the (v + /,/:) MDS code is (by using Eq. (4)) 



E <-»' 

i=0 


| (<jW-(d-(n-/))-/+l _ 1) 


be decoded into a codeword of weight other than 0. There- 
fore, 5(z'j , z 2 , • • • , ij) contains all words having weight that is 
less than or equal to t in the coordinates (0, 1, • • • , n - 1 } - 
( FU {/j , i 2 , • • • , ij }). This completes the proof. ■ 

Theorem 4: 


\S(i x ,i 2 r • * , i.) I = q u 1 for u-t<j<u 

( 8 ) 

Proof: Since / is greater than or equal to u - /, the number 
of zeros is equal to v + j and is greater than or equal to n - t. 
Therefore, the number of nonzero components is less than or 
equal to t. Thus, all words with zeros on FU {i x , z 2 , * ■ ■ , z)} 
are decodable and this completes the proof. ■ 


for d - u + / < w < t and 1 for w = 0. For each codeword c 
with weight win FU •••, z)}, where d' < w < t 

(d* = v + j - k + 1), we must count the number of e’s such that 
c + e vanishes on F U {z’j, z 2 , • • • , z)}. Suppose that e has 
weight s > w. e must match c exactly on F U {/j, z 2 , • • * , 
/)}, but the s - w other nonzero components can be arbitrarily 
placed outside F U {i 1 , z 2 , • * * , z y -}. Then the total number of 
rs for a given c of weight w on F U {/ x , z 2 , • • • , z ; - } is 


E 



(« - 1)’-” 


When w = 0, all components of e must lie outside the set 
F U {z j , z 2 , • • * , ij }. So there are 



(Q - 1 V 


P s for the case w = 0. Combining the above results, we obtain 
the theorem. ■ 


Theorem 3: 


= g ^ , 7 ) (?-iy (7) 

forzz-d+t+l</<w-/-l. 

Proof: For A:-v + /</<w-r-l,the number of zeros in 
a decodable word is greater than or equal to k + t but less than 
or equal to n - / - 1. Thus any decodable words in 5(z 1? 
z 2 , • • • , ij) have weight that is less than or equal to d - t - 1 . It 
is not hard to see that the element of S(i v z 2 , • • *, ij) cannot 


As in I.C.l, we choose z 15 z 2 , • • * , z ; - from v - n - u coor- 
dinates. Thus, for every choice of /, we have (“ ) S{i l , z 2 , • * * , 
iff s- Denote Nj = (“) I 5(z 1 , z 2 , * • * , z)) |. Again, by the 
principle of inclusion and exclusion, we see that the number 
of decodable words which have exactly v = n - u zeros at F 
equals 


j=0 

However, we have (") = (") ways to choose v zeros from 0, 
1, • * • , n - 1. Thus, the number of decodable words of weight 
u is given by 


D 



E 

7 = 0 


for d - t < u < n 


( 9 ) 


3. Simplification of the key formula. The weight enumera- 
tor formula that we have just derived is complicated and 
clumsy. There are four different expressions fork’s, and these 
expressions are combined together by the inclusion and exclu- 
sion formula. The following theorem will show that the weight 
distribution formula for the number of decodable words in a 
linear MDS code can be simplified, and that there are only two 
expressions for then’s. 

Theorem 5 : 


u-t-l 
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( 10 ) 
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Proof: 



D 
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for d - t < u < n 
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for 0 < / <u-d 


N t ■ 


E 

w-d-u+j 


In-u + j 
\ w 


E(-%y 


c-D / 


w-d+u-j 

x E 

1 = 0 


(<? 


w-d+u-j -i+1 
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= (q-l) u -(q-l) u 


x t 

S = W 



(q - 1 y- w 
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for w - d + 1 < / < u - d + t. 

Examples will be found in Tables 1 and 2. 


Notice that 




and 


then 



£ = 

\ i / \ / / 

;=o \ 1 / V/ 


for t + 1 < / < u - 1 . 



Thus, /l = 0 and the theorem is proved. 


D. Remarks 

The formula for the number of decodable words of weight 
«, where d - t < u < n, has been derived in the previous 
parts of this section. If we set t = 0, then we get back the 
weight enumerator for linear MDS code— Eq. (4). In the case 
of u - d - t, for example, we have 


d-t 


00 -" 

and the answer is consistent with the result derived in [6] . 


The formula is a bit clumsy, but can be easily imple- 
mented by computer program. 


II. Decoder Error Probability of a 
Linear MDS Code 

A. Number of Decodable Words vs. 
Decoder Error Probability 


With Theorem 5 and Eqs. (5), (6), (7), (8), and (9), the Let C be an (n y k, d) linear code capable of correcting 

weight enumerator formula can be simplified as follows: t errors. When a codeword c E C is transmitted over a corn- 
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munication channel, channel noise may corrupt the transmit- 
ted signals. As a result, the receiver receives the corrupted 
version of the transmitted codeword c + e , where e is an error 
pattern of some weight u. If u < t 9 then a bounded distance 
decoder on the receiver’s end detects and corrects the error e 
and recovers c. If u > f , then the decoder fails and does one of 
two things: 

(1) It detects the presence of the error pattern but is 
unable to correct it. 

(2) It misinterprets (miscorrects) the received pattern 
c + e for some other codeword c f if the received pat- 
tern falls into the radius t Hamming sphere of c\ 

Case (2) is, in most cases, more serious than case (1). This 
can occur (with a nonzero probability) when an error pattern 
e is of weight u> d - t. Let us further assume that all error 
patterns of weight u are equally probable, and let us use 
P ' E (u ) [7] to denote the decoder error probability given that 
an error pattern of weight u occurs. It is not hard to see that 
P E (u) is given by the following expression: 




D. 




ford-t<u<rt (14) 


That is, P E (u) is the ratio of the number of decodable 
words of weight u to the number of words of weight u in the 
whole vector space. Thus, the problem of finding the P E {u)\ 
is essentially the same as the problem of finding the weight 
distribution of the set of decodable words. Equations (11), 
(12) and (13) of Section I and Eq. (14) of Section II together 
enable us to find the exact decoder error probability of a 
linear MDS code. 

Let the probability that a completely random error pattern 
will cause decoder error be denoted by Q. It is the ratio of 
the number of decodable words to the cardinality of the whole 
vector space. That is, 


Q = 


or - 1) v n (t) 


is the volume of a Hamming sphere of radius t. It is shown in 
the next part of this section that if q > n, which is generally 
true, then P E (u) approaches Q very rapidly as u increases. 


B. Examples and Observations 

Two well-known examples of linear MDS codes— the NASA 
code and the JTIDS code— are tabulated in Table 3 and Table 
4, respectively. In these two examples, we observe that P E (u) 
approaches the constant Q as u increases. In fact, P E (u) 
approaches Q rapidly for u <C n. In the case of large q and 
q > n, P E (u) approaches Q even for u <d. The P E (u) and Q 
of the NASA code agree to eight significant digits for u > 
26 (d = 33). If P E (u) and Q are interpreted combinatorically 
as ratios, then we have the following relationship: 


# of decodable words of weight u 
# of vectors of weight u 


#of decodable words 
# of words in vector space 


This astonishing relationship cited above implies that a linear 
MDS code, which possesses rigid algebraic and combinatoric 
structures, behaves (in some sense) like a random code with no 
structure at all. Some laws of large number come into play 
somehow. 

In order to describe analytically how fast /£•(«) approaches 
Q when u is large, an upper bound on the expression | [P E (u)/Q] 
— 1 1 is derived in the following paragraphs. This upper bound is 
denoted by U(a), where u > d. It will be shown that U(u) 
approaches a very small number e as u increases. 

As in Section I, let D u denote the exact number of decod- 
able words of weight u. Let A^-’s be the corresponding terms 
in the inclusion and exclusion formula of D u as expressed in 
Eqs. (11), (12), and (13) of Section I. LetZ^ denote the esti- 
mated number of decodable words of weight u. Let Nj\ be the 
corresponding terms in the inclusion and exclusion formula of 
D u . The expression of Nj, 0 < / < u is constructed by extrapo- 
lating the first term on the right-hand side of Eq. (12) of 
Section I from 0 < j < u - d to 0 < / < u. We now have the 
following equations for D u and Nj : 




(15) 


* - 0 § 


d-t^uKn (16) 


where r-n-k is the code’s redundancy and 


N { = \q U - d+l ^V(t) 


0 < / < u 


(17) 




Now we want to find an upper bound, denoted by for 
Nj in Eq. (13) of Section I for u - d + 1 < / < u - d + t. 
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r / u _ j\ Note that (y) q u - d+1 ~j V n (t) = Nj < Uj , and so Uj > max 

) (4 - l)*“ w {A^, AJ-}. Also, with the additional assumption that q > n, 

\ s - w/ which is generally true, Uj is a descending function of /. 


• (It, (-:>-< 


Now let us consider the second term on the right-hand side 
of Eq. (12) of Section I, and denote it by 0(u). We want to 
find an upper bound for ©(w). 



i ± (”r)(;::) 


s=d-u+j 


w=d-u+j 
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We then want to find an upper bound of \D U - D u |, where 
d<u<n. We have 



We are finally ready to derive an upper bound for | [P E {u)iQ] 
- 1|. By the definition of D u in Eqs. (16) and (17), it is not 
hard to see that 



- t 

j=u-d + 1 


+ ©(f) 


Now for cKu <n, 
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+ 0(w) 


f-u-d + 1 



P E (u) 
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-l 


q n D 


{q-\fq k V H (f) 


(set N. = 0 for u - d + t + 1 < / < u) 






u 

^2 max {N., N . } + &(u) 
/=u-d + 1 


q n (D -D ) 

n V U U 7 



q n \D -D | 

U u ' 


(q -If q k V(t) 


ln\ 
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E ^ +0 ( u) 

w 

_ j~u-d + 1 
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[ <w u . d+l + ©(“)] 


q d ~ l 2 “ V u *(t) 

\q-\Y Vn® 


dj f 


u (u) 


(U. is a descending function) 


where 



F (f) + 2" F*(f) 





(q ~ 1)' 
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and 



+ q *- 1 2 “ 

(q ~ IT 


VJT) 


= U(«) 


The upper bounds of | [P E (u)/Q] - 1 1 of the NASA code and 
the JTIDS code are tabulated in Table 5 and Table 6, respec- 
tively. 


Thus, the upper bound U(u) of | [P £ (u)/Q] - 1 1 , which is a 
function of u for d < u is given by the following equation: 



C. Remarks 

With the assumptions that q is greater than or equal to n 
and that u is large compared to d , Eq. (18) shows that the 
upper bound of | [P E (u)/Q] - 1| is dominated by the denomina- 
tor term (q - l) u . Thus, the upper bound of | [P E (u)/Q] - 1| 
decays nearly exponentially as a function of u. This upper 
bound is not a very tight bound, but it is sufficient to illustrate 
the point that P E (u) approaches Q very rapidly as u increases. 
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Table 1. (4,2) MDS code over GF( 5) with t - 1 


Weight 

Number of decodable words 

Upper bound [6] 

0 

1 

- 

1 

16 

- 

2 

48 

48 

3 

192 

272 

4 

168 

272 


Total number of decodable words = c^V n {t) - 425. 


Table 2. (6,3) MDS code over GF( 4) with t = 1 


Weight 

Number of decodable words 

Upper bound [6] 

0 

1 

- 

1 

18 

- 

2 

0 

- 

3 

180 

180 

4 

405 

855 

5 

378 

1026 

6 

234 

513 


Total number of decodable words = q k V n (t) = 1216. 


Table 3. NASA Code: (255,223); RS code: q = 256, t = 16 

P E (11) = 9.4641648 X 10 -15 
^(18) = 1.9130119 X 10' 14 
^(19) = 2.4010995 X 10~ 14 
2>£(20) = 2.6598044 X 10 -14 
^£<21) = 2.6017177 X 10 -14 
P E ( 22) = 2.6076401 X 10 -14 
P e (23) = 2.6087596 X 10" 14 
P E ( 24) = 2.6088773 X 10 -14 
P e (2S) = 2.6088880 X 10 -14 
P E ( 26) = 2.6088888 X 10“ 14 
P £ ( 27) = 2.6088888 X 10~ 14 
P e (2 8) = 2.6088888 X 10“ 14 
i>£(29) = 2.6088888 X 10' 14 
P £ ( 30) = 2.6088888 X 10' 14 
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Table 4. JTIDS Code: (31,15); RS code: q = 32, t = 8 

P £ (9 ) = 3.7493431 X 10 -7 
P E (10) = 1.4392257 X 10" 6 
7> £ (11) = 2.9507015 X 10" 6 
7^(12) = 4.3287703 X 10 -6 
7> £ (13) = 5.1888955 X 10~ 6 
7^(14) = 5.5466000 X 10~ 6 
7^(15) = 5.6291887 X 10 -6 
7^(16) = 5.6296979 X 10 -6 
7^(17) = 5.6255686 X 10 -6 
7^(18) = 5.6256673 X 10 -6 
7^019) = 5.6259065 X 10“ 6 
7^(20) = 5.6258313 X 10~ 6 
7^(21) = 5.6258455 X 10 -6 
7^(22) = 5.6258434 X 10" 6 
7^(23) = 5.6258437 X 10“ 6 
7^(24) = 5.6258437 X 10 -6 


I 


Table 5. NASA Code: (255,223); RS code: q = 256, ( = 16 


u 

U (a) 

33 

5.133 

34 

0.3422 

35 

0.0157 

36 

5.526 X 10“ 4 

37 

1.512 X 10“ s 




Table 6. 

JTIDS Code: (31,15); RS code: q = 32, t = b 

u 

Ufa) 

17 

19.35 

18 

5.618 

19 

1.148 

20 

0.1851 

21 

0.02508 
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